Synchronized pulses identify and locate targets rapidly

ABSTRACT

Stimulation of a sensor array, by edges comprising a feature pattern, optical characters or moving edge(s), emits pulses that converge at nodes in serial arrays, which reemit rapidly if input pulses are in temporal synchrony. The repetitive pulses traverse the serial arrays without encoding image features in a temporal data stream that decodes as an image frame. This dimensional reduction of serial arrays reemits convergent one-dimensional (1D) pulses in greater numbers when stimulus feature patterns match sensor or node topographical patterns, thereby serially extracting context, optical flow and inference. Reemitted 1D pulses rapidly identify and locate looming targets without repetitive feedback.

PARENT CASE TEXT

The present application contains subject matter related to subjectmatter in U.S. patent application Ser. No. 15832,565, filed Nov. 29,2017, now issued as U.S. Pat. No. 10,769,447, titled “SynchronousConvergent Pulses Reduce Dimensions of Serial Surfaces”, which claimspriority under 35 U.S.C. Sec. 119(e) to U.S. Provisional Application No.62/497,726, filed Dec. 1, 2016, which are hereby incorporated byreference in their entirety.

DESCRIPTION

Field of Invention

Neural Networks, Optical Flow, Pattern Recognition, DistributedComputation, Feedback, Variable Frequency Oscillator (VFO),Nano-sensors, Phase-Locked Loop (PLL), Parallel Processing, OpticalCharacter Recognition (OCR), Deep Learning, Memory Lookup, Robot Grasp,Anticipatory Synchronization.

Background of Invention

Information theory formalizes methods to parse an image into binary bitsfor coding and transmittal between locations. However, this can requiresophisticated algorithms to encode, decode, and store the data overtime. For example, target identification and acquisition typicallyrequires algorithms that calculate and predict a future target locationfrom successive integration of temporally coded information thatreconstructs image frames. Prior art also requires 2D target coordinatesto be coded and transmitted to a central processor to calculate thecurrent position of sensors with respect to an identified target. Incontrast, here the match of target features with matching topographicalpatterns of stimulated sensors to convergent nodes selectivelyidentifies and locates a target at the same time with generic pulses.The initial steps of selective reemission of pulses by successivespatially and temporally convergent nodes is prospectively faster,especially as a target nears, than repeated feedback of data streamsthat code image frames, to and from a central processor.

In human neurons, the rate of spikes generated by stimulation of asensory retina, reduces serially at successive synaptic stages, from theretinal ganglion cells (RGCs) to the lateral geniculate nucleus (LGN)and in individual cells in subsequent areas such as V1 andin-ferotemporal (IT) cortex. This reduction in maintained spike firingrate, as neurons spatially converge sensory inputs from the peripheryinto cortical perceptual areas with increased numbers of cells withinlarger receptive field (RF) areas, has been found true for sensorysystems in general. Some have interpreted this reduced neural spikerate, due to spatial and temporal summation at serially convergentsynapses, as multiplexed data, in a hypo-thetical temporal or latencycode in neurons, analogous to the transmittal of coded data in wires.Others have presumed that the repetitive information in an image isencoded and decoded to reconstruct the image from compressed or sparseinformation. In an effort to copy the nervous system's economy ofinformation transfer, neuromorphic chips condense binary codedinformation into packets that are time-multiplexed, with each packettime- and origin-stamped and addressed to specialized processing units.This avoids the congestion of information at a central processing unit,known as the von Neumann bottleneck, analogous to retinal convergence,in which the fibers from primate receptors spatially converge on RGCneurons in an approximate 60:1 ratio, before fanning out in anapproximate 1:350 ratio of RGC neurons to V1 neurons. The apparentanalogies between neural and computational systems are used in othermodels to code, transmit and decode still images from a sensor surfaceto a location that performs programmed cognitive functions upon theinformation in the image frame. An advanced nervous system isconventionally interpreted to take ‘snapshots’ of visual images witheach shift of the retinal surface during fixational eye movements(FEMs), but these images to be stored in memory, have to be sparselycoded to conform with presumed anatomical and actual electronic codinglimitations. These previous interpretations are only a partial use ofthe neurophysiological evidence and inevita-bly conmingle informationtheory with experimental data in a way that creates more con-foundedcomplexity. Massive experimental data supports neural spike synchrony asa mechanism that couples perceptual processing of sensory input andcommunication between cortical locations. Recent analysis in reputablelabs shows that little information is transmitted or communicatedbetween neural locations in the synchronized or phase-locked state.Embodiments in this invention use rapid reemission of pulses fromtemporally synchronous inputs stimulated by connected feature patternsthat thereby also rapidly synchronize proximal-distal serial nodesconnected in serial arrays, as an alternative to the delays oftemporally coded information repetitively transmitted between locations,to identify and locate a target in space with reference to a sensorarray.

One prospective embodiment would improve stereo vision goggles used invirtual and augmented reality, which synthesize binocular stereo imageryfrom algorithms that compute the information in monocularly changingimagery transmitted in temporally coded streams, which due to slightasynchronies of image timing creates dizziness and vertigo in the wearerafter a short time. This and other embodiments described in this patent,use the reduced summation times at serially convergent nodes oftemporally synchronized pulses, rather than algorithms and reiterativefeedback that calculate current target loci in binocular 3D space, toincrease serial precision of synchronized emitted and reemitted pulses.Other embodiments here use monocular or binocular optical flow increasesin proximal-distal motion parallax (looming), which by rapidlyreemitting 1D pulse outputs, thereby avoid colli-sions with concurrentlyidentified and unidentified targets as they near sensors.

Also based on temporally coded images, conventional machine or deeplearning algorithms repeatedly cycle, or back propagate, streams ofimage information, comparing false posi-tives with previously learnedimage templates, which incrementally stream temporally coded informationto probabilistically quantitate an output from paired alternatives. Thisrepetitive feedback takes substantial time and computational resources.The invention here does not alter the digital connectivity of modularcircuitry in neural networks by repetitive learning with differenttarget templates, but compares maximal least-time pulse responses ofmultiple target stimuli, at a selective layer of many terminal nodes(FIG. 1). Neural networks in this invention do not temporally code 2Dinformation in streamed 1D data, but temporally synchronous pulsesincrease the speed and intensity of convergent 1D pulses fromtopographically selective serial circuits, without the delay required totrain circuits with similar targets in repetitive learning trials.

Overview

A comprehensive treatment of the ideas, logic and evidence underlyingembodiments of this invention is in the book Synchronous Neural Time(2018), by the inventor, available on the internet. In the inventiondescribed here, pulses (analogous to spikes in neurons) transduce thedetail of edge-stimulated 2D image information, which impedance matchesat a synchronization frequency, aligned and connected nodes (analogousto synapses in the brain) in serial surfaces, layers or arrays (theseterms are synonymous here). Therefore no x-y information is temporallyencoded or multiplexed, by pulses to a distal location to be read out ordecoded, but pulses constitute an impedance matching 1D z dimension thatintegrates convergent nodes in serially aligned 2D arrays via thefrequency or rate of pulses emitted at an initial sensory array. In thisinvention, packets of information or spikes, are replaced by pulses inelectrical circuits, which integrate, via the spatially and temporallyintegrative dimension z, proportional increases in both location andtime at serial nodes.

A z pulse is defined here as equivalent to a single spike or a group ofrapidly repeated spikes that are limited, or phasic, in duration. Pulsesmove when stimulated at a fixed time by a specific stimulus, such as animage 2D edge shape at a feature-selective 2D sensor pattern, or amoving edge at a sensor, corresponding to an ‘event’ detector. Acondition of the existence of the z pulse is that it is not stationary,or a store of static information, but travels at a relatively constantspeed, near the speed of light or of electrons over the wired, linked orconnected (used interchangeably here) distance between serial nodes,organized orthogonally as serial 2D arrays. A node here is hardwired orprogrammed as a coincidence detector, reemitting a pulse only when itsinput or most or all of its multiple inputs spatially and temporallysynchronize, reemitting a pulse within a specified window of time.Similar to resonant microwave or acoustic cavities, z pulses make use ofrepetitive, serial 2D surfaces that reiterate the initial stimulatedsensory surface; at any instant, these moving z pulses are at aproportional distance and time as they traverse each serial array. Ifsustained pulses are at a sufficient speed and have a minimal temporalinterval between any serial pulses equivalent to the distance betweennodes in encompassed 2D arrays, the synchronization of any specifiedproximal-distal arrays at the pulse frequency occurs with little or nophase lag. As shown in rapid synchronization experiments, this phaselock occurs much faster than the transmission delay of a single spikebetween two neural locations, so requires at least two moving pulses asa synchronizing context. Here the interac-tion of 1D z pulses atserially convergent 2D arrays that summate from temporally synchronous zpulse inputs, creates a 2D x-y synchronization context that facilitatesrapid synchronization of reemitted 1D z pulses. The repetitivegeneration of parallel z pulses by FEMs initially, causes a temporallysynchronized (or resonant) frequency over the z distance between anyspecified 2D aligned and convergent nodes in serial arrays (FIGS. 1,2B).

1D z pulses act as a transiently repetitive third dimension, so in thepresent invention do not temporally code or multiplex information in anybinary or other coding scheme used for streaming temporally coded data.This mobile z dimension, constituted of pulses at a specific rate orfrequency, integrates linked nodes regularly spaced in repeated 2Dsurfaces as a periodically stable 3D structure during synchronization.If at a sustained rate from the same x-y synchronous edge pattern, thepulses are in effect, identical in time and information content, eventhough each individual pulse is sequentially generated, due to theemergent context of z pulses repeatedly present at linked nodes at thesame transient repeated times in orthogonal, repeated 2D arrays. Theidentical time and information content of temporally synchronized pulseswith the same distance/time (or distance/latency) ratio, even thoughsequentially distributed along a z axis, not only are necessary forrapid or ‘anticipatory synchronization’, but bind perceptual and neuraltemporal synchrony mediated by FEMs that input successive 2D windows ofsynchronized time from external photon emissions (FIG. 4B).

In this invention, the time required for pulses to synchronizeproximal-distal 2D arrays is not dependent on the quantity ofinformation at the 2D sensor array that could be encoded and transmittedas bits in connected wires as in conventional systems, but dependsinstead on the gating frequency that synchronizes the periodic emissionof pulses from the edge-responsive sensors of the initial 2D sensorysurface. Generally, the synchronous emitted times of gated z pulses thatspatially converge at nodes in any 2D surface reemits pulses at afrequency that synchronizes with the distance, latency and speed to thenext 2D surface. Because the synchronized 1D z pulses at any distallocation are a result of specific edges at specific x-y sensorlocations, pulses that distally reemit, while not multiplexingtemporally coded sensor data, are the displaced, temporally synchronizedz locations of edges during, in organismal vision systems, the fixationperiod that encompasses multiple FEMs, or cycles, of the sensor arraygating frequency. During synchronization of serial 1D pulses at 2D arraynodes, emitted fixed times of moving 1D pulses adjust to coincide withsequential 2D synchronized time at each fixed 2D array, to enable pulsesynchronization on 1D z axes. This relativity of fixed times of movingpulses and moving sequence of times at fixed array locations creates acontext in which fixed pulse times that change location are con-vertible(or synchronize) with moving, sequential time at each fixed arraylocation. During any specific FEM, due to photon impingement on retinal2D arrays at a synchronized time from all external distances, sequential1D z spikes are emitted in orthogonal synchrony from sensory 2D arraysthat rapidly create a z synchrony of multiple pulses (or spikes) eventhough differences exist in the variable latencies of photon origins.These differences, at any synchronized 2D gated instant of time due toFEMs, enable a context of connected 3D space in each sequential perceptthat accrue as the perceptual moment.

Corresponding to the coordination between the minimal fixation periodand the temporal length of the perceptual moment in physiological vision(both measures approximate 150 msec in humans), sustained sensor zpulses elicited by spatially simultaneous 2D letter or feature edgepatterns, travel from the sensor surface to synchronize with latentperceptual pulses at distal nodes. To match the stimulated photon inputsduring the perceptual moment with a cortical perception in humanstemporally, the sequentially reemitted 1D z pulses impedance match, viasynchronization that dissolves latency and distance differences ofinputs, each 2D array's reemission of convergent z pulses. Inpsychophysical and physiological experiments, a stimulus of just a fewmsec is distinguishable perceptually as an emitted time, because inaddition to a sustained train of spikes during the perceptual moment,phasic spikes of short burst duration mark the initial stimulation eventelicited from specialized On RGCs. In a neural network as envisionedhere, phasic and sustained pulses spatially and temporally synchronizeon convergent nodes in arrays, to reemit 1D z pulses during each gatedfrequency cycle. But the detailed sensory information that issynchronized during the shifting or gating frequency of the sensorarray, is not transmitted as a 1D data stream, so is not defined orlimited by bandwidth or bit rate during the synchronized state. 1D zpulses sustained at a gating frequency by a stationary or moving edgepattern, emit at a rate with approximately the same spatial interval asthe temporal interval of z pulses emitted and distributedproximally-distally for a synchronized duration of time. In embodimentshere, the synchronous times of the multiple z 1D pulses at the resonantgating frequency, do not require proximal sensory information or targetreference coordinates, to be decoded or reconstructed as an image frameor with specific target reference locations, at a distal CPU.

The gating frequency of the 2D sensor array emits x-y synchronized zpulses, at temporal intervals that coincide with wavelengths andfrequencies corresponding to distances and latencies between serial 2Dsurfaces. If there are no stimulated edge crossings in any shift-cycleof the sensor array, no synchronized z pulses emit for that cycle.However a detailed, complex image emits many temporally simultaneous zpulses in any cycle of the gating frequency; it is possible to modifysomewhat the gating frequency in response to stimulus intensity toincrease precision, or to modify the amplitude of each cycle to alterthe sensor response to edge contrast. Microwave design theory provides abasis that impedance matches the distance between 2D cross-sectionalsurfaces with the inversely proportional frequency generated between thesurfaces. Here, distance between specific linked nodes arranged inregular 2D arrays, not information density, bit rate or bandwidthcapacity, governs the z frequency over that linked distance. Amplitudeor frequency modulation, or phase differences of similar frequencies,which in prior art are used to code and transmit information, are notused here because edge emitted-times impedance match event detection atthe periodic gating frequency of the sensory array with each displaced zlocation of pulses. While information theory has created data thatresult in better understanding of the brain, it should not be assumedthe brain's sensory systems use the same methodology.

The initial conjunction of edge stimulation with orthogonal sensor arrayfrequency synchronizes, or impedance matches, the periodic timingbetween edge-generated pulses and the proportional wavelength or latencyto specific nodes in serially distant 2D arrays. Conventionally, PLLscorrect via feedback of measured phase differences, the phase-lockedfrequency specific to the distance between two nodes. Here, the resonantfrequency is inversely proportional to the distance or wavelengthbetween connected nodes that reemit in phase from temporally synchronousinputs, so varies with the z latency between the specific connectednodes. A coincidence detector, or convergent node here, responds byreemitting to temporally synchronized inputs, from equidistant orequally latent input nodes, in which the synchronization interval isdefined by the periodic frequency of emitted z pulses that synchronizethe specific linked or connected nodal distances. What areconventionally measured in neurophysiology at an electrode location asphase differences, which are ag-gregated to obtain an average spikefrequency, are here, specific phase-locked frequencies tuned to specificz distances between specific nodes.

The periodic synchrony of moving z pulses is an intrinsic feedbackmechanism that impedance matches the repeated emitted time of sustainedpulses at a gating frequency with times of substantially identicalgeneric pulses latently reemitted from connected nodes in serial 2Dsurfaces. The orthogonal sensor surface makes the variable unit distancelocations (at varied focal lengths) of normally impinging photonssimultaneous in time at each synchronized instant of z time caused byeach gated shift (that emits zero-crossing x-y edge events) of 2Dsurface sensors. Each cycle of a gating frequency (corresponding to aFEM) generates a cycle of a z axis frequency, measured by single pulseor a short burst of pulses from initial convergent nodes, which, alsomeasured as pulse rate, transform synchronous convergent inputs at x-yarrays to serially emitted 1D z times that synchronize repeatedly atdownstream serial 2D arrays (FIG. 2B). Synchrony can also result fromconventional recurrent feedback of convergent pulses emitted from aserial 2D surface to nodes in a previous surface. Proximal-distalintegration of 2D serial surfaces by synchronized 1D z pulses requires achange of mindset from information transfer in a temporal code of binarymaster-clocked pulses to one of impedance matching, or synchronizationof serial 2D arrays, by a normal projection of repeated 1D z pulses.This requirement for a moving z time dimension, which transiently andrepeatedly integrates connected nodes in repeated 2D surfaces whentemporally synchronized, does not violate any physical laws.

The prior embryonic development and definition of specific anatomicalroutes are very important for the specialized stages of visual function,as shown by the neural convergence and divergence to the variousquantities of neurons, or nodes, specific to each serial convergence atorthogonal arrays of the RGC, LGN, V1, V2, . . . stages of the visualsystem. Binocular fusion, robotic reaching, size constancy for objectidentification, location constancy (circuit convergence from any part ofthe visual field to a serial node's large RF), proximal-distal opticalflow for space constancy, sensed from relative motion parallax ofobjects at serial convergent nodes in serial arrays, and locatingtargets without 2D or 3D reference coordinates relative to a sensorarray, as well as hippocampal memory lookup, use variants of neuralcircuitry that serially converge and diverge to repeated arrays of 2Dnodes (FIGS. 1, 2C, 2D).

Brief Summary of Invention

In one aspect of the invention, repeated, serially aligned 2D surfacesdimensionally reduce to a single periodic structure, enabled by a thirddimension of z pulses moving in wired or connected links between theserial nodes. Reemitted pulses are timed in periodic temporal intervalsthat transiently position the moving pulses at serially linked nodes inserial 2D surfaces at the same synchronous time (FIGS. 2A, 2B). While itseems inefficient to time pulses at intervals or latencies from nodes inan array to aligned and convergent nodes in another serial array, ratherthan transmitting at a high bit rate, it is more efficient if a proximalimage is not reconstituted distally with 2D information streamed as 1Ddata. An advantage of this aspect is that image frames are dimensionallyreduced via 1D z emitted pulse times at initial nodes; 2D imageinformation or reference target coordinates, are not required to beencoded proximally or distally decoded. This coordination of synchronousplanar 2D x-y time with sequential 1D z time creates in-crementalspatial and temporal precision not apparent if the presence of the sameedge is averaged over time (FIG. 6).

In another aspect of the invention, the emitted time of pulsestimulation is retained by the proportional distance/latency of themoving z pulse at any elapsed time after stimulation. The survival, ormicro-memory, of any z pulse over time and distance requires thatlatency accrues, without a tag or code, to the emitted time of any zpulses that rapidly reemit at serial nodes; this periodic reemissionalso synchronizes z pulses proximally-distally (FIGS. 4A, 4B). Thetemporal synchronization of pulses proximally-distally retains the pulseemission time (FIG. 3A), by the proportional change in location of thisfixed time when temporal synchronization rapidly reemits at convergentnodes at proportional distances. By moving at the same speed as similarpulses from a proximal surface, at a synchronized frequency or pulserate, the sequential position and latency of the pulse in relation tothe reemitted train of pulses is maintained. The retention of emissiontime in moving pulses is important in physiological vision; specializedphasic On-RGCs emit a train of spikes of short duration, specificallystimulated by the short passage of a stimulus edge at a receptor edge.In experiments, the spike response to externally moved stimulus edgesand to internal physiologically generated FEMs is recorded with the sameintensity and duration, meaning that observer imposed referencecoordinates do not distinguish internal self from external non-selfstimulus movement to orient physiological target acquisition mechanisms.

The repeated coordination between sequential 1D z pulses and serialorthogonal 2D layers of convergent nodes that only reemit fromtemporally synchronized inputs, rapidly synchronizes emitted times andmoving pulse locations at frequencies and wavelengths matched withdistances between stationary nodes at repeated cycles of FEM emissiontimes. This impedance matching synchronization is an intrinsic feedbackmechanism that combines static times of emitting and reemitting pulsesat static nodes, at which time moves sequentially. Becausephysiologically, orthogonally synchronized spikes emitted by a 2D RGCarray with each cycle of FEMs constitute human conscious neuralexperience at any single instant of synchronized proximal-distal neuraltime, external physical reality is experienced as connected 3D space.

In a third aspect of the invention, the match of moving 1D pulselocations with static serial orthogonal 2D locations is important fordegrees of optical flow detected by the observer at any increment ofmeasured time and sequentially over time. Optical flow is measured bythe relative dx/dt and/or dy/dt speed, of parallax motion (at variedspatial distances or varied focal lengths) with reference to aperceptually stable background, in which increased relative motion,along with the looming size of stimulus features that substantiallymatch topographical sensor patterns, increase emitted pulse rates, withconcomitant reduced spatial and temporal summation time at convergentnodes, and therefore increased speed and intensity of reemitted latentpulse perceptions. In physiological nervous systems, spike rateincreases with larger size, increased speed and closer distance (orlooming size) of the stimulus. The more rapid reemission of pulses byfeature and edge 2D patterns that substantially match sensortopographies and serially convergent nodes of varied topographicalcomplexity, is computationally faster than the decoding and comparisonof serial image frames at a central processor from temporally codedstreams of spatial information.

Repetitive z pulses at sequential nodes in serial 2D arrays, as well asspeed of pulses, use the same dz/dt notation here, in which dz/dt=aconstant, is both a constant speed and a proportionally constantdistance/latency ratio, of topographically aligned serial x-y locationsalong a z axis. Therefore, the conversion of distance to time andvice-versa, is enabled by an impedance match of dual constant ratios.Photons from various distal locations in external physical space impingeon an x-y sensor surface in each cycle of a gating FEM; in other words,differences in optical flow in 3D external space are comparativelysensed in each synchronized instant of time of the 2D sensor array ineach fixational ‘snapshot’. These differing optical flow speeds on anorthogonal sensor array are measurably not the same, but are perceivedin the same 2D gated cycle of x-y time; continuously reemitted,synchronized 1D z frequencies impedance match external distal andproximal differences in 3D target distance, origin in time and varyingoptical flow.

In a fourth aspect of the invention, the z dimension, emitted as pulsesin response to a feature-specific topographical sensor pattern, changeslocation a proportional 1D z distance according to a gating frequency orpulse rate, generated at a sensor 2D x-y array. A slower pulse frequencystimulates a more distal node because the longer distance requires alonger wavelength, or latency, for temporally synchronous pulses tosummate at the distal node. The distal node may recurrently reemitpulses as feedback on a previous emitting node to temporally synchronizeemission with reemission pulse timing intervals, or to synchronize thestatic pulse emission time with the elapsed latency that results frompulse speeds and summation time delays between resonating seriallylinked nodes.

The gated emission and reemission frequencies from patterns offeature-selective sensors and nodes generate the temporally synchronizedpulses that move the z dimension to terminal nodes, which selectivelyintegrate 1D pulses emitted by combinations of stimulatory featurepatterns. Initially generated pulses from feature edges rapidly reemitfrom temporally and spatially convergent 1D z pulses, these rapidlyreemitted pulses recognize the feature by the concomitant higher pulserates passed by serially selective nodes. Z pulses sustainedproximally-distally, allow the z location and timing of the proximalstimulus to transiently but repeatedly synchronize distally, withouttemporally coding detailed x-y information that would otherwise in otherart stream as data to reconstruct sequential image frames. The increasedreemitted pulse rate, due to a substantial match between a featurepattern and a stimulated pattern of nodes, is a measure of not only morerapid recognition, but greater accuracy and precision of recognition,which is directly due to faster summation by more pulses at seriallyconvergent nodes. Increased quantities of pulses are due also to loomingsize and/or faster parallax speed due to increased optic flow,indicating that a higher distal reemitted rate of pulses is fasterrecognition of relevant feature patterns. In addition, because the manyterminal nodes can individually respond to many types of 2D featurepatterns by topographical groups of serial nodes, these differentperceptions in the same distal convergent array of differentiating nodesare compared with previously standardized 1D responses to featurepatterns, rather than by temporally coded sequential de-cisionsfor/against a specific feature pattern learned over many trials (FIG.1).

In a fifth aspect of this invention, the synchronization of emitted zpulse 1D times, moving at dz/dt speed across proportionallocations/times in serially hardwired 2D x-y arrays, matches moving zpulses with specific proportional locations/times, in which atopographically stable (hard-wired) serial 2D location and associatedlatency impedance matches a moving, changing latency of each z emittedtime. In memory lookup, pulse speed, dz/dt, synchronizes a 1D z pulsefixed emitted time with a stationary location and latency (resonantfrequency) of a node in a 2D array, as a dual moving z and stationaryx-y spatial and temporal match of distance/latency. Because pulse speed,pulse emitted time, and proportional frequency and latency at a node alltransiently synchronize, time and space (frequency and wavelength) atany node are relativistically interconvertible. This relativisticre-lationship is expressed as a constant that impedance matches humanperception of 3D space at 2D arrays with serially reemittedproximal-distal 1D spikes, and theoretically facili-tate memory lookupin 2D mapped locations.

In a sixth aspect, a dz/dt constant pulse speed on any 1D z axis, inwhich the constant dz/dt ratio coincides with proportional (constantratio) distant/latent serially matched 2D node locations, indicates adimensionally reduced impedance match of moving 1D z pulses with staticserially matched 2D x-y nodes. A constant pulse speed dz/dt and aproportionally constant serial dz/dt ratio synchronize, via orthogonalserial 2D arrays that reemit 1D pulses from temporally synchronizedpulse inputs. The concept of rapid or ‘anticipatory’ synchronization inthis aspect, requires this impedance match of speeding 1D dz/dt emittedpulse locations and stationary, serially aligned arrays composed of 2Dorthogonal, temporally synchronized reemitting nodes. The larger timeunits at longer, more distal locations in physical space, expressed as alonger wavelength and lower frequency, create a sense of spatialstability that coincides with slow distal optical flow; thisperspectival stability also does not require a target to reemit 2Dreference coordinates in a temporally coded data stream to enablecontinuous space constancy.

In a preferred embodiment for a reading apparatus, feature selectivenodes respond to specific 2D spatial patterns of inputs, correspondingto letters or characters, which converge upon an equidistant node withina limited temporal window, to reemit a z pulse or burst of pulses, inresponse to the specific word signaled by the letters. This occurs inrepeated stages of spatial convergence, with succeeding reduced pulsefrequencies, until a terminal node reemits z pulses that temporallysynchronize, during the total perceptual moment, with pulses sustainedby the proximal spatial information. The z pulse rate at the terminalnode is too low to convey the peripheral spatial sentence information.The rapid shifting of proximal information during reading does notrequire specific responses by specific distal nodes to specific lettersand words; generic categorization responses that converge in least-timeto specific terminal nodes synchronize with specific stimulatory lettersas they change during repeated reading fixations. Pulses gated by arepetitive orthogonal sensor array frequency, in which proximal sensorsare specifically responsive to rapidly changing letter information,synchronize at distal nodes with local clusters of nodes responding inleast-time to convergent 1D z pulses, which enables recognition,inference and abstract meaning to emerge from the shifting proximalletter pattern.

The above described embodiment is only one of many possible forrecognition of any spatial pattern. Other embodiments relevant torepetitive cycles of generic 1D z pulses without the encoding ortransfer of bits of 2D information are described in the detaileddescription of this invention but are not limited to the examples given.

A preferred embodiment for a categorization and identification device ofstimulus targets or shapes, uses the synchronous emission and reemissionof pulses to synchronize proximal stimulus specificity with a latentdistal categorization, based on a convergent path of stimulusedge-generated pulses that converges most rapidly on specific terminalnodes, among many possible (FIGS. 2A, 2B, 2C, 2D). This least-time paththrough selectively serial nodes does not require the cyclic repetitionof feedback information between nodes in repeated layers or arrays tolearn the identity of the peripheral stimulus feature pattern over time,but does require previously standardized reemitted pulse 1D responses atdifferentially responsive terminal nodes to previous exemplars. Theassociation of the pulses emitted by a specific edge-pattern with distalrecognition or identification, by least-time pulses reemitted tospecific terminal nodes, is shown by analyzing time, embodied in movingpulses, into emitted, latent, synchronous and sequential contexts on thesame 2D plot (FIG. 4). These intrinsic time properties do not code,transmit and decode information that reconstitutes a stimulusrepresentation at a distal location, or repeatedly cycle temporallycoded data streams for algorithmic analysis of stimulus patterninformation.

Another embodiment provides for synchronous coordination of a robot handreaching toward and grasping a target (FIGS. 6, 7). The analysis of timeinto components is a part of this invention that eases the comprehensionand display of increased precision and reduced latency of maximalresponse near the target, which does not require looping delays ofinformational feedback, but is due to feature edge patterns thatsubstantially match with sensor patterns, with concomitant faster pulsereemission rates. This is an advantage over the technology that becomesless precise due to information feedback delays that are larger thanpulse reemitted speed and rate of optic flow near targets as sensorarrays near looming targets.

A last embodiment uses the fastest reemitted pulses traversingproximal-distal array convergent nodes for differential identificationand recognition of a stimulus target by the most selective nodes in thelast array. Only sustained slower spikes from the target objectsynchronize proximal target 2D reference loci with distally convergent1D perceptions and feature recognition (FIGS. 1, 2). The largestquantities of pulses emitted and reemitted most rapidly during shorterwindows of time to specific terminal nodes, differentially identifiestargets, so does not require 2D location information to match withtemplates in memory. Because the identification of a target in thisembodiment does not require repetitive learning from many exemplars thatmodify layers of nodal circuitry, but a standardized modular circuitrythat responds to previously defined exemplars to reemit repeatable,least-time 1D responses comparatively differentiated at specificterminal nodes, learned biases that accrue can be avoided. As describedhere, 2D/3D reference locations of a target are retained by theoperational connection of sustained sensor array pulses that synchronizewith distal selective recognition/identification by nodes withleast-time pulse responses (FIG. 7).

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1) This version of a neural net composed of nodes in serial arrays,selectively propa-gates pulses that temporally synchronize at nodes.Specific nodes respond fastest to convergence/divergence filtered bytemporal and spatial pulse synchrony at serial nodes, from anymultidimensional stimulus location. Serially reemitted 1D pulses fromthe most strongly matched stimulus features and 2D node patterns,filters to a few feature responsive nodes of many nodes in the lastserial array.

FIG. 2A) Synchrony exists if reemitted pulses are concurrent with newlyemitted pulses from the same feature pattern. 1D z pulses that rapidlyreemit at serial nodes synchronize at frequencies (or harmonics thereof)and wavelengths that approximate the distance between two given nodes.

FIG. 2B) Temporally synchronous monocular pulses emitted by the samedually mapped edges of a feature pattern, reemit from binocularlyconvergent nodes at a frequency and wavelength approximating thedistance and latency between serial arrays, for sharp 3D depthresolution.

FIG. 2C) Edge patterns stimulate sensor types that converge outputs fromspecific edge orientations to initial nodes. The temporal synchrony ofpulses emitted by a stimulus edge, or from an edge pattern, converge inmultiple input links that summate at initial and subsequent nodes, whichreemit serially selected 1D pulse outputs.

FIG. 2D) The 2D properties of the stimulus, such as its area, stimuluslocation in the sensor array and orientation, filter out in the serial1D z outputs. The selective reemission of serial 1D z pulses isadjustable. The fastest pulses to nodes in the last array, whichidentifies or recognizes the stimulus target or its category, precedesustained pulses from the same target that emit and reemit from seriallystimulated nodes.

FIG. 3A) The emitted time of a stimulated z pulse is fixed as it movesto distal locations. This fixed time is a ‘micro-memory’ of thestimulated event, since it also acquires latency with distance.

FIG. 3B) A stimulus area's x-y edge pattern emits temporally synchronouspulses at ‘2’ that converge at a serial node ‘1’ to reemit 1D z pulses.This serially sustained process illus-trates that 1D z pulses do notmultiplex x-y information, but reemitted 1D z pulses temporallysynchronize with 2D fixed time pulses locally mapped at sensors.

FIG. 4A) 2D time, mapped to orthogonal 2D spatial axes on a 2D page,analyzes generic time into synchronous, sequential, fixed emitted andlatent time components. The lack of a location and time code tagged onidentical z pulses, enables the dimensional reduction of serial 2Darrays by reemitted 1D z pulses in synchronous proximal-distalfrequencies.

FIG. 4B) Fixed pulse times at a 2D sensor surface emit synchronously ata gating frequency; the emitted pulses retain these times asmicro-memories, due to the constant distance/latency ratio resultingfrom temporally synchronous input pulses at nodes that summate andreemit 1D z pulses rapidly.

FIG. 5) During a reach, sequential z pulses synchronize at progressivelocations along the z axis.

FIG. 6) A moving target edge progressively synchronizes pulses from asensor array, which also synchronizes temporal and spatial precision atsensors with a distal node response to the target edge.

FIG. 7A) Conventional feedback of temporally coded information requiresdelays for algorithms to compute spatial errors. These delays reduceprecision near the moving target, when more is needed.

FIG. 7B) Pulse rate from a 2D sensor array increases as it nears thetarget, thereby increasing the precision and decreasing least-timeconvergence of pulses to feature identifying nodes in the last array.

DETAILED DESCRIPTION OF THE INVENTION

Theory of Synchronization Based on Brain Mechanisms

Embodiments of the present invention are now described in more detail;in concert with the figures, they enable those skilled in the art toexecute the invention. The descriptions of convergent circuits thatfollow, take advantage of the synchronous timing characteristics ofemitted pulses, caused by the repetitive cycling of an initial 2D x-ysurface consisting of repeated sensors, pixels or other types or formsof sensory or edge detection. Gated pulses stimulated by stimulusfeature edges and emitted by edge detector sensors, are controlled bythe orthogonal shifting of said surface, or of a shifting screen over anon-shifting 2D surface, or of a fixed transmittal rate (in Hz) of a CCDarray or CMOS chip, or any other sensor assembly, or of a frame rate orexposure time in a camera, at an amplitude sufficient to elicit edgeresponses from individual sensors or pixels in an array. Anyedge-stimulated patterns of pulses converge via linked serialtopographies (65 and 80 in FIG. 1) of nodes that individually respond tospatial and temporal convergence of pulses emitted by pattern featuresor characters (FIG. 2D), or the movement of target edges across sensors(FIG. 6). The shape- or object-specific 2D pattern of linkededge-generated pulses (70 and 85), coupled with the orthogonal frequencythat synchronizes the z pulse emission times in gated cycles, temporallyand spatially converge pulses at serial feature-selective nodes (86, 87,88), culminating at differentially responsive nodes in the last array(100) in which the high-est magnitude and thus least-time pulses passpreferentially through serial convergent arrays 110, 120, 130, 140).Because of the serial increase in filtering selectivity of convergentnodes in serial arrays to impinging temporally synchronous pulses, pulseoutputs reemit most rapidly in convergent 1D z axes, routing to veryselective nodes in the last array (89). This least-time routing does notrequire any temporal code, latency code, or incre-mental adjustment ofsynaptic weights to bias pulses onto a specific path over many trials.But the 1D z pulses that converge most rapidly to specific nodes in thelast array (150) due to an adjusted parameter (420 in FIG. 2D), surviveto give a latent recognition of the fastest pulses emitted by a stimuluspattern at its x-y sensor array locations (100). The 2D information ofvariable stimulus size, location and orientation at a sensor array (100,170) is serially filtered out (181) by reemitted 1D z pulses.

With conventional technology, 2D edge information is transduced bysensors and encoded as bits. Here, while sensor topography selects forfeature orientation, or sensor types select for light wavelength,haptic, ultrasound, microwave or other stimulation, the z pulses withinthe convergent sensory field specific to a sensor type, do notthemselves encode feature information, except that pulse intensity(increased pulse numbers in the same latency and summation time) isproportional to the intensity of stimulation by the feature pattern. Aninitial layer or array of coincidence detectors, or equivalentprogrammed or hard-wired components, reemits pulses over a relativelywide temporal window to accommodate differences in sensor latencies dueto gray areas in the object and feature or pattern varia-tion. Partialstimulation of individual sensors by the filled area of the stimulusthat affects latency, is also accommodated by this relatively widesynchronization window; but subsequent arrays of spatially convergentnodes accept pulses from narrower windows of temporally synchronizedinputs. The specific edge-emitted times, conveyed by z pulses over theduration of stimulation by the gating frequency of the sensor surface,periodically synchronize in each serial stage of spatially convergentnodes or similar coincidence-detecting circuitry as previously stated.At each serial 2D surface, equidistant, equally-timed z pulses convergespatially at a few nodes in the array of nodes; if the pulses impinge onthe nodes within the synchronization window, 1D z pulses reemit rapidly,temporally synchronized with the cycle of sustained outputs from aprevious 2D surface (FIGS. 1, 2). Nearby convergent nodes in the samelayer that are not equidistant from previously stimulated nodes, do nothave equally timed, synchronized pulse inputs from a proximal stimulusfeature pattern, so do not rapidly reemit pulses z-synchronized, orphase-locked, with orthogonal x-y inputs. The moving z pulse locationssustained from initial stimulation of the 2D sensor surface synchronizeat the gating frequency: if synchronously emitted z pulses from thefirst layer of nodes or sensors have a total duration at the nextreemitting layer of nodes that is approximately equal to the duration ofone cycle in the gating frequency, reemission occurs (102, FIG. 4B).This gating frequency may be adjusted to the distance and summation timeat a layer of nodes by VFOs, PLLs, FPGAs, ASICs or any synchronizationdetecting components integrated into the circuitry (FIGS. 2A, 2B, 420).Because the initial 2D surface may have a topography of overlying layersof different sensor types (330), convergence of inputs on subsequentnodes, from simultaneous stimulation of the 2D sensor surface at theimposed gating frequency (FIGS. 1, 2D, 4B) and/or slower drift acrossthe sensor surface (FIG. 4A), allows a serial z synchrony to establishin parallel and convergent z axes, from the connected edges constitutingan object feature pattern. A high shunt impedance between parallel x-yaligned z pulse pathways reduces blur and retains sensor resolution,while a low series impedance in z pathways between repeatedtopographically aligned arrays, allows pulse rates or frequencies atresonant wavelengths, to rapidly synchronize from temporal and spatialpulse coincidence at convergent nodes.

While the least-time response is due to convergent input patterns thatmatch topography of early and intermediate nodes, it is also adjustableand configurable at an interface (420) to select output pulse rates andfrequencies as shown in (340) that make up repeated cascades in serialarrays of nodes (FIG. 1, 2C). The specific stimulatory feature pattern(65, 80) sustains pulses that reemit at maximal rates by specific nodesin the last array (320), which respond fastest to temporally synchronouspulses reemitted through downstream serial arrays. The x-y locations ofsustained pulses generated by the sustained presence of thefeature-connected edges of a pattern at any 2D location (330), or amoving edge event at sequential sensor locations (FIG. 6), is temporallysynchronous with pulses reemitted from the last array (320). Therefore,1D z axis pulses (300, 305, 310, 312) that selectively propagate toconverge at a few nodes in the last array (320) not only recognizestimulus targets by least-time/high magnitude pulses, but sustainedpulses that summate more slowly also have longer intervals toaccommodate the increased distance and latency to the selective lastnodes (FIG. 2A), which sustained pulses are temporally synchronous withconcurrent pulses emitted by sensors and initial nodes (330) by thespecific stimulus feature patterns and moving events at any 2D locationin the sensor array (FIGS. 2A, 2C, 2D, 6). This sustained temporalsynchrony is not multiplexed information (FIG. 4A), but integratesproximal 2D variable information with distal identification of thetarget features, necessary for reaching to a specified target (FIG. 5).

The different sensor types that respond to specific object features takelinked routes to nodes that respond to temporally synchronous inputs, inwhich specific spatially convergent circuits, or coincidence detectors,also respond to the topography of sensors stimulated by a featurepattern within a narrow window of time that is adjustable (420). Thisprocess is analogous in the brain, to the serially repeated anatomicalconvergences at synapses in V1, V2, V3, V4 layers, etc. that terminateat cell clusters in IT cortex (a simplified schema is shown by thenetwork in FIG. 1). The synchronization at convergent nodes in the lastarray (150), of the fastest, least-time pulses emitted by the specificpattern of x-y pulses at the sensor surface (100), makes the stimulatedlocation of the proximal array's sustained pulse pattern (100, 102)synchronous with pulses at distal spatially convergent nodes (FIGS. 1,2C, 2D, 4B). Spatial and temporal resolution of features, and locationand size of a specific x-y stimulus, are defined at the sensory 2Dsurface (100, 330) and the serial arrays that define 3D binocularresolution from monocularly emitted pulses (FIG. 2B). However, emittedstimulation time is a fixed micro-memory retained by proximal-distalpulses in continual movement to convergent nodes (FIGS. 3A, 4B) inserial arrays, which spatially and temporally synchronize (FIGS. 4A, 4B)proximally sustained pulses with reemitted fixed pulse times at distalnodes.

At distal nodes, including at least one node in the last array, areduced frequency of z pulses does not decode or reconstruct the complexinformation in the proximal sensor image to make it identifiable, but isin phase with the complex information impedance-matched by the typicallyhigh pulse rate of sustained pulses emitted by the 2D feature pattern(100, 102). Here it is the spatially and temporally convergent z pulserate or frequency at distal nodes (315, 320) that temporallysynchronizes with pulses emitted at the sensor array frequency (102) byspecific x-y patterns of inputs; this information is not encoded byphase or latency differences, which are in spikes that are in anaveraged frequency typically recorded from physiological electrodes overmany trials. Here distal z frequencies result from the feature-selectivecircuitry that directs z pulses, via least-time temporal and spatialconvergence, to reemit synchronously from a distal node. The specifictemporal and spatial inputs that cause reemission of z pulses, convergeon nodes in the next array (86, 87, 88), which in turn, have adistributed, selected least-time reemitted response that inputs to thenext layer of nodes. The simplified node circuit shown in FIG. 3B (manyother versions are possible to those schooled in the art) can bemultiplied in cascaded arrays of convergent nodes (FIGS. 1, 2C). Theserially reemitted z output pulses do not transmit multiplexedinformation, but at convergent nodes reemit a single z dimension (withno multidimensional properties) in pulses temporally synchronized withthe complex features, orientation, size and location of stimulation atproximal sensors. 1D z pulses here have no defined temporal coderequired to reconstitute a 2D stimulus, but move sequentially andrepeatedly through any distal node that reemits from, and thus select,specific spatially linked and temporally synchronized pulse inputs (fora brain, this repeated latent reemission is perceived continuity).Moving distal z pulses can also recurrently stimulate, or feedback upon,the feature and temporally selective nodes in the previous 2D layer. Thefeature selective, spatially patterned links to convergent nodes haveserial increases in RF area (FIG. 1) due to increasing numbers of linkedinput nodes (86, 87, 88, 340).

The proximal sensors that select various features converge with the sameinput type at ad-ditive nodes in initial 2D arrays (110, 120, 130, 180),but multiple convergences of sensor and node types may be necessary toselectively respond to multisensory RF patterns at convergent nodes in alast array (150). A few selective convergent nodes, of many nodes (89)with overlapping RFs in a last array (150, 190, 320), reemits 1D zpulses most rapidly and maximally from input pulses routed by spatialand temporally synchronized reemis-sions from repeated filteringcomponents or circuits in serial 2D arrays (312, 315). The temporallysynchronous pulses do not themselves temporally code shapes or featurepatterns. Because the orthogonally distributed filtering circuit modulesare specialized for each serial array, subject to the balance ofselective parameters designed into the inte-grated circuitry, specificdetails, such as location, size and spatial resolution are notreconstituted from temporally coded, tagged or streamed information, butrather, least-time z pulses synchronize proximal x-y spatial andtemporal information (102, 170, 330) with convergent 1D z pulse movinglocations reemitted selectively by nodes in serial arrays including thelast array (150, 190, 320). The serially reemitted convergent pulsedimension, z, eliminates the multidimensional complexity that isfiltered by serially linked nodes in arrays (FIG. 3B), in favor ofreemitted 1D z pulses that transiently synchronize linked nodes indownstream serial arrays.

Pattern Recognition by Synchronized Convergence without LearningAlgorithms

Conventional machine learning uses a resource and time intensiveapplication of algorithms that learn responses by the repeated streamingof binary information through layers of digital switches in a neuralnetwork and so, in a successive trial-and-error back-propagationprocess, eventually ‘recognizes’ a temporal coded pattern indicated byprob-abilistic convergence to a learned template. The process describedhere reduces the in-tensive use of computer resources, by thestandardization of nodes in circuit modules, or similar integratedcircuitry specific to each serial 2D array, which are preset accordingto empirically derived convergent synchronization parameters (420).Superficially this is simi-lar to evolutionary algorithms, whichiteratively evolve the fittest solution from temporally coded data,except the process here does not mutate or customize circuitry for eachnew application. Here a least-time maximal response results from theproximally sustained input pulses that synchronize with the distal fewpulses that have reemitted through filtering circuits or convergentnodes, as shown in networked serial arrays shown in FIG. 1. The processhere finds the fastest route for spatially and temporally synchronouspulses emitted by as little as one stimulus presentation, whichleast-time select one of many possible routes through circuits that areset and prototyped, to a few of many similarly responsive nodes withoverlapping RFs (FIG. 2C). If different templates are previouslypresented to the neural network embodied here, the different routes thatselectively activate different nodes in the last array define thesimilarity of subsequently presented ‘new’ stimuli. Different 2D sizesor locations of the same stimulus category, which temporally synchronizeat spatially convergent midlevel nodes, synchronously reemit 1D z pulsesthat have no multidimensional properties, but maximally activate one ora few specific nodes in a large terminal array of nodes (150) thatsynchronizes with the proximally defined multidimensional information(FIGS. 1, 2A, 2B, 2D). Topographically repeated arrays respond to anyorientation of features at any x-y location, analogous to simple cellsin V1 cortex, which filter pulses emitted by different edge orientationsin the specific feature pattern, to reemit 1D z output no matter whatthe 2D feature orientation, which diverge/converge to multiple nodes inthe last array (FIG. 1), and also converge synchronous 1D pulse patternsfrom any stimulus x-y location into a shortest, rapidly reemitted z pathwith a proximally-distally synchronous response. 2D information is nottransmitted to distal nodes by 1D pulses in this invention; spatialinputs temporally synchronize at serial 2D arrays of selectiverepetitive nodes, so that only temporally synchronous convergent 1D zpulses ultimately reemit. Proximal-distal z pulses synchronize theproximally sustained, specific x-y location and feature information atthe same time as a distal 1D z filtered reemitted abstraction seriallyemits from spatially convergent nodes (FIG. 3B).

The function of coinciding temporal and spatial reemissions at serialnodes is not only rapid synchronization on convergent z-aligned axes,but when a phase-lock occurs at the same transient times at nodes assustained by the previously emitted z frequency or a sensor array'sgated shift frequency, no sequential transfer of temporally codedinformation occurs due to z pulses proximally emitted and sustained bythe fixated presence of the same edge pattern. Here, the spatial patternof x-y sensors stimulated by the edges of an image object or a movingedge, moves fixed emitted times of z pulses via links labeled by inputsensor type. Initial impedance matching occurs because specific variablestimulus information evokes an equally specific, variable sensor pulseresponse. But rather than variable feature information coded andmultiplexed over time in convergent connections to a terminal decodingsite such as a CPU or GPU, here only synchronized emitted times of zpulses move. The fixed instant that a specific sensor or edge detectoris stimulated to emit a moving pulse or phasic burst of pulses, ispreserved by the movement of this burst in space and time along z axes(FIG. 4). Sequentially shifted gating (or sensor surface clock rate), issynchronized with the z latencies between linked nodes in serial 2Darrays. A just-stimulated population of an edge or shape pattern ofpulses, corresponding to a stimulus shape, is synchronized at each cycleof the gating frequency of the initial sensor surface; these fixedemission-time pulses temporally and spatially synchronize withleast-time precision at serial z aligned and convergent nodes, due toequal speeds, travel latencies and distances of the connections to aselectively filtering, least-time maximally responsive node in a serialarray comprised of many nodes (FIGS. 1, 2C and 4). The variableinformation of a changing or moving stimulus pattern alters the sensorpopulation that responds at any specific time, but is regulated by theorthogonally gated frequency or rate of pulses emitted at eachincremented cycle of synchronized 2D time at the sensor surface. Theemitted time of the pulse is fixed, even when elapsed over time, becausethe linked distance traveled by the pulse to the next rapidlyreemitting, convergent node is proportional to the latency from theemitting x-y synchronized sensor location (FIGS. 2D, 3, 4). Theequivalence of x-y orthogonal synchronization frequency with z axissynchronization frequency fixes the initial emitted time and convergentlatent time of sequential pulses in the recurring pulse frequenciesbetween pairs of linked downstream nodes (FIG. 3B).

Intrinsic temporal properties of generically defined pulses needanalysis, to understand how the movement of pulse z locations paststationary anatomical nodes, induces contextual emergence of emitted,latent, sequential and synchronous time (FIG. 4). Anyone schooled in theelectronic arts should be able to implement the circuitry that matchesthe gated timing frequency of edge-emitted pulses with phase-lockedfrequencies of the same now latent pulses at distally convergent nodes.The sustained, repeated cycling of z pulse emission times transientlyintegrate as a dynamic x-y-z 3D structure in a context of sustainedsequential pulse times. In contrast, the short burst of pulses emittedby a large subset of RGC types, traditionally interpreted as edgedetection, here facilitates temporal synchrony at convergent nodes,rapidly reemitting 1D z pulses serially at selective nodes to a specificfew nodes in the last array, which precisely identifies/recognizes thestimulus, due to least-time reemission of maximal pulse numbers from thestimulus that match serial spatial topographies of spatially integrativenodes most precisely. Because least-time selective convergence to atleast one terminal node exists (315, 320), many stimulus feature typesare discriminable simultaneously by comparing maximal responses ofleast-time pulses in an array of terminal nodes.

Sustained pulses, emitted from another large subset of RGCs, reemitpulse frequencies that approximate the latencies between linked nodes(FIGS. 2A and 4). This z synchrony due to sustained z pulses from thesame edge or spatial edge pattern during fixation, last for the durationrequired to activate distal nodes by sequential traversal of serial 2Darrays. This sequentially generated proximal-distal synchrony allowsdistally delayed cognitive per-ception to track the current position ofa target, without increased delays due to recurrent informationprocessing of successive image frames of many targets to be rated as torele-vance or impending danger. In this embodiment, phase-locked distalz pulses have the same synchronized time as that sustained by theproximal edge pattern (FIG. 4A).

Rather than spending many trials to train a neural network with variousslightly different versions of a temporally coded stimulus image tocreate a probability of a correct response to a new stimulus, here themodular nodes in each serial array use a much reduced num-ber oftraining trials if used in concert with a learning algorithm, since thez pulses in response to similar stimuli take a least-time convergent zroute, via serial filters of nodes in 2D arrays, which synchronizeconvergent pulses via intermediary nodes (300, 305, 310, 312 in FIG. 2C)to maximally responsive nodes in the last array. The continuouslysustained proximal pulses emitted from the sensory array create adynamic persistence of long latency z pulses on z axes; these sequential1D z pulses create a z-axis continuity, over time and distally linkedconvergent nodes (400, 410, 415), which differentiates this inventionfrom conventional phosphor persistence on a 2D screen that results fromtemporally coded raster scans of an image that blurs, or has a jitterystrobed effect, from the x-y movement of objects or of the camera'ssensor array, in the conventionally reconstituted image. This model ofleast-time convergent z synchronization at specific identifying nodes ofmany terminal nodes, in the aspect of the invention described here, isan advantageous alternative that uses less time and computationalresources, than learning algorithms that sequentially compare targetswith learned templates. In this invention one hardware/software designof circuit modules, using differentiating stimuli, determines with aminimal number of trial iterations, least-time/maximal response pathwaysof 1D pulses to identifying nodes in a last array.

Convergent Least-Time Synchrony and Stereo Vision

In another aspect of the invention, z synchronization is especiallyadvantageous for 3D stereo vision, which requires precise timing ofsignals from dual x-y aligned monocular images in current technology, tocreate spatial-temporal differences in depth of the stereo imagepresented via screens or goggles to an individual's eyes. In theembodiment here, synchronous monocular z pulses emitted by the same x-ymapped edge(s) impinge at least-time convergent binocularly activatednodes, in serial arrays similar to the retinotopically aligned layers ofV1, V2 and V4 cortical 2D surfaces (FIG. 2B). Serially linked binocularnodes (250) respond to the matched monocular disparities in the positionof the same edge in the 3D connected edges of the dual 2D images. Theyalso respond to the relative parallax, or distance to a moving objectthat becomes higher resolution, as the magnification of the objectincreases closer to the object. Here, binocular nodes (250) reemitrapidly only from monocularly matched links (210) that conveysynchronized monocular pulses, with equal travel times from the samealigned x-y edge-locations. The convergence of synchronously activatedmonocular pulses from the same edge (200), in serial binocularlyactivated nodes that respond to the stereoscopic distance and theparallax at that distance as monocular sensor arrays get closer to thesame edge of the object, reemits high pulse rates that correlate withthe higher 3D resolution at close distance to the target. Thesynchronously summated, reemitted pulse times have a high binocularprecision that increases with the increase in separation, or disparity,between the dual monocular sensor representations of the same edge. Theselection of synchronous inputs from the same edge, by sequential 2Dlayers of retinotopically aligned binocular nodes, coupled withproportional pulse asynchrony that results from the degree of disparityand parallax of adjacent nodes with less precisely aligned monocularinputs, reemits to create a proximal-distal ordering of perspective andoptical flow in 3D space. Because binocularly integrated, reemittedpulses are in temporal synchrony with the sustained, dually alignedmonocularly emitted pulses, a monocular tag identifying x-y location andemitted time is not necessary and not communicated by z pulses in thisembodiment, in which pulses spatially and temporally synchronize mostprecisely at a binocular rapidly responding node in an array containinga plurality of potentially responsive nodes. This continuously reemittedprocession of sequential pulses at high frequency that repeatedlysynchronize all stages of serial retinotopic nodes, which creates 3Dstereo precision, improves on current procedures that usecomputationally expensive resources to calculate and extract, from theoverlapping temporally coded spatial reference coordinates of dualmonocular images, 3D location. The 1D z pulse serially reemittedleast-time synchronization here, is not a multiplexed version ofperipheral monocular information, but endures as an increasingly latent,precise, distally reemitted continuous response to the x-y synchronized,sustained emission times of monocular feature edge patterns. By avoidingrepetitive algorithmic computations of absolute 3D reference coordinatesat each increment in time, cumulative imprecision and temporal laggingbetween sequential monocular images are avoided in the embodiment here,when reemitted from temporally and spatially synchronous high pulserates, onto stereo screens, in virtual reality goggles or roboticgraspers. The implementation of convergent circuitry described herereemits more rapidly and precisely from temporally and spatiallysynchronous impedance-matched dually mapped inputs to 2D arrays ofimaging nodes to create a less fatiguing stimulation of thegoggle-wearer's eyes. Adjacently mapped nodes in a binocular planararray, do not rapidly reemit if a relative topographical asynchronyexists between monocularly stimulated sensors from the same edge, but doreemit rapidly to a screen (or screens) of stereoscopic imaging nodes ifat equal latencies from edge-matched monocular images.

Spatial and Temporal Synchrony Mediate Space Constancy

In another aspect of the invention, a direct result of the temporal andspatial precision of synchronous input pulses at distal convergentnodes, is that the x-y jitter that necessarily results fromedge-generated pulses resulting from the orthogonal gating frequency ofthe peripheral 2D sensor surface (or periodic shifting of a screenfronting the surface), is used to synchronize the temporal timing of zpulses emitted repetitively from the same x-y location of the sensorvis-a-vis a stimulus edge. Stimulus edge-crossings at a gated or clockedfrequency emit z pulses that move at a speed synchronized with distanceto serial arrays of spatially convergent but also retinotopically mappednodes (FIGS. 2A, 2B, 2C), to match the timed intervals of gated pulseswith summating latencies at pluralistic nodes in distal arrays (250),which reemits 1D z pulses from 2D spatially and temporally synchronousinputs at each phase-locked instant of emitted z time, preservingproximal temporal and spatial pulse resolution distally. Coincidentally,the spatially convergent temporally synchronous dual monocular pulsesreemit a single binocular pulse without the x-y input jitter, due to thesingle z output pulse remitted from each x-y aligned pair ofsynchronized pulse times (FIG. 2B, 3B).

It should also be noted that due to physiological retinotopic serialarray registry, spatial stability is always at a reference (0,0)position at serially convergent synapses, despite shifting of the visualfield on a sensor array due to large saccades, which is easilyreplicated in artificial mechanisms. The binocular outputsynchronization from monocularly paired input pulses, spatiallystabilizes each cycle of orthogonal x-y jitter without averaging overaccumulated cycles of high gating frequency jitter. Current artificialparadigms that ‘pool’ via repetitious application of algorithms,temporally coded, temporally unstable images, so that a stable image isaveraged over time, reduce the spatial and temporal resolution of there-constructed image due to fine and/or continuous changes over time. Inthe embodiment here, because the x-y label of monocularly emitted zpulses is not present at a spatially convergent serial node (FIG. 3B),and a serially mapped node's reemissions have a period that synchronizesor phase-locks with pulses emitted at the sensor gating frequency (420in FIG. 2D), the repetitively synchronized instant of the z dimensionreduces binocularly aligned 2D surfaces to a proximal-distalperceptually stable 3D stereo structure, of high spatial and temporalresolution, at each reemitted phase-lock of the proximal gated pulsefrequency (FIG. 2B). Multifunctional reemitted 1D z pulses mediate bothbinocular stereo synchronization and spatial stability; here, theimpedance matched response of convergent z pulses that respond to anyperipheral stimulus type does not require the conventional multiplexingof temporally coded information transmitted to a stable distallyreconstituted image at spatially convergent terminal nodes in a lastarray. A regular frequency of reemitted 1D z pulses, without shifting 2Dx-y information and thus x-y stable, spatially and temporally convergeat repeated nodes in distal arrays; image stability is a property oftemporally synchronized 1D z pulses and not of orthogonal topographicalarrays encoding 2D information in larger distal RF areas. Because distalconvergent z pulses also have a proportionally increased latency with nox-y jitter at the distal wavelength and frequency of proximal-distalsynchronous pulses, emissions of the pulses can be skipped cyclically,while still retaining x-y-z stereo synchrony and phase locking atmultiples of the proximal wavelength between pulse (FIG. 2B).

To restate the interpretation here, z pulses, analogous to physiologicalz spikes, are moving locations and fixed emitted times in one zdimension, not shifting x-y information that is decoded in the processof stabilizing the 2D image. The requirement for high frequency inputpulses that converge at spatially convergent nodes within a short timewindow to cause reemitted pulses, eliminates noisy uncorrelated inputsat early stages of convergent circuits. Convergence of z pulses fromseveral sensor types at a distal convergent node, does not average ormultiplex presumed temporally encoded information emitted at theproximal sensor or pixel surface, but each stimulus edge at each sensorat the gating frequency, emits pulses that synchronize at a convergentnode (FIGS. 2C, 2D). Because the z dimension is 1D synchronous and usesserial x-y spatial convergence to serially reduce reemitted z pulse rateat low stimulus intensities, convergent distal 1D z pulses are notaffected by variable multidimensional properties such as orientation,size or reference loci of inputs (FIG. 2D). Z pulse reemissions fromproximal x-y synchronized sensors, synchronize latently at distal arraysof node(s), which also stabilizes any peripheral jitter in x-y sensorresponses, via synchronous convergence to one dimension of z pulses(FIGS. 3 and 6).

Synchronization of Proximal Precision with Distal Abstraction

Another embodiment of the sequential transfer of z location by pulses,shows that it is not necessary to repeat the precise sensor or pixeltiming in subsequent serially convergent, synchronously activated z axisaligned nodes. While repeated x-y registry at serial 2D surfaces retainsx-y resolution and precision (as spatially convergent monocular inputsfor binocular stereo vision, for example), the fact that sustainedfixational inputs emit from an initial sensor surface, means that arange in temporal delay or quantity of pulses at a convergent node maylose temporal resolution, though not sequential order, if the convergentterminal node does not rapidly reemit. This loss of precision withserial summations or recursion is, in microwave theory, a loss ofquality (Q) factor, which defines quantitatively the loss in resolution.Here, synchronous timing of z pulses at the proximal sensor surfaceretains this timing at a distal convergent node if quickly reemitted atintervening serial nodes, or phase-locked with sustained proximalpulses. However, if pulse speeds are synchronized with proportionaltravel distances and latencies (FIG. 2B), this causes increased spatialand temporal convergence to lengthen the summation period at eachserially active node (415), so that less temporally precise pulsesreemit at distal convergent nodes. In physiological spike recording ofFEMs and in some machine learning paradigms, increasing the time-binduration for averaging spikes increases the positional and temporalstability of a neuron's RF, with increase in RF area. The longersummation period and longer latency of pulses at a convergent terminalnode synchronizes with the rapid rate of emitted pulses sustained atproximal sensors or pixels (FIGS. 2C, 2D); the slower convergentreemitted pulse rate synchronizes at reduced frequency, but at everysecond, fourth, etc. cycle of the high sustained proximal pulse rate.The fixed emission times of pulses that have endured during fixationover a linked distance, is synchronous or phase-locked with repeatedstimulation by a stimulus edge. Because this sensor-emitted, fixed pulsetime is repeatedly present in the convergent receptive field of aterminal node, the synchronous effect is that sequential z time hasfused with increased pulse latency.

Proximal-Distal Synchronization Embodied as a Reading Mechanism

In another embodiment of the synchronized movement of z pulses with notemporally coded information to convergent nodes, a rapid readingmechanism results. Such a mechanism requires the stepped transfer of zpulses stimulated by each orthogonally synchronized x-y pattern of edgesthat make up letters, words and sentences. The multiplexed transfer ofall the information in the edges that make up letters as they are read,taxes the current ability of a central cognitive analyzer. However ifthe pattern of pulses in response to the letters in a word, temporallysynchronizes at a convergent node that reemits a single pulse to aspecific word letter pattern, then successive reemissions, from repeatedconvergence of z pulses emitted by spatial and temporal synchronizationsof stimulatory letters, words and sentences, acquires a serial increasein abstracted meaning (FIGS. 2C, 3B). This graduated increase in contextfrom convergent word summation is able to filter out discrepancies dueto words that are interpretable in multiple ways. Rather thantransmitting an increase in pulse rate corresponding to increasedcontextual information, the temporally synchronous z pulses emitted fromspatially defined inputs, first as letters, then words, and thensentences, increase spatial convergence and temporally integrate asreemitted slower pulse rates at each serial node. Because the terminalconvergent contextual interpretation of a sentence, reemitted fromserial spatially convergent nodes by temporally synchronous pulses,synchronizes with z emitted times sustained by the proximal spatialpattern of letters, the information in the letters does not need to becoded and transmitted centrally as a temporal multiplexed code. Thespecific convergent route of z pulses to specific distal nodes is afunction of the specific edge pattern that is x-y synchronous at sensors(330, FIG. 4B) and serially filters as an impedance matchedproximal-distal z synchronization (FIGS. 2A, 2D). These proximal-distalrelationships are specific to the x-y edges of letters, which result inleast-time/maximal cascades of non-informational z pulses, whichspatially converge via integrated nodes as shown for a simple circuit inFIG. 3B. The route to any of multiple nodes in the last array variesaccording to least-time reemissions of temporally synchronous pulsesthat impinge on the next equidistant convergent node in seriallyrepeated arrays. This preprogrammed route can latently change accordingto the changed meaning of stimulus words or acquisition of new words,which can be programmed as changes in software that affect reemissionparameters (420), or learned from newly asyn-chronous proximal-distalrelationships that correct via synchronization at nearby nodes in thesame array. Specific proximal sensor information synchronizes with thedistal node's convergent synthesis of meaning and context from thatproximal information; dissonant z asynchronies result if contextualmeaning is not least-time consistent with proximal x-y data. Therefinement of contextual meaning occurs with a window of exposure tostimulatory data at a sensor array that is long enough to establishsuccessive temporal synchro-nies at spatially convergent serial nodesculminating at least-time distal nodes without requiring successivefeedback of temporally coded information or a repetitively appliedalgorithm that learns to become more probabilistically accurate inrecognizing a word sequence or other data by comparison with a specifictemplate. The quickest route to any of many nodes in a last array, whichrepeats to exposure to the same or similar words, governs the convergentdimensional reduction of many proximal sensors in an x-y array, seriallythrough arrays of similar nodes, to a few nodes in a last array. Asshown in FIG. 3B, the 1D z pulse reemits from two or more synchronousinput pulses, which are without location or time tags or aninformational code. The 1D pulses have no 2D (such as letter location orfont size) properties, due to repeated 2D arrays of spatial links thatconverge pulses; as moving z locations and times, serially reemittedpulses spatially and temporally synchronize in least-time with theactual variable sensor 2D information. This process does not diminish inspeed or efficiency with increased amounts of stimulatory information,since here, only 1D temporal synchronies transmit through 2D arrays todistal nodes, and so reduce frequency with the distance or wavelengthbetween pulses transiently at linked nodes (FIG. 2D).

Sensory Data Synchronously Converges to a Distal Synthesis

Other embodiments of spatial sensor convergence that temporallysynchronize sensor-emitted pulses at serial nodes, are useful forintegration of the outputs of for example, monochromatic color sensors,which respond differentially to the intensity of RGB or CMYK specificcolors, at each specific image pixel, to give an integrated responsespecific for a single hue, among thousands possible. Anatomically, thisdistal retinotopic map reiterates the proximal image map, but thisdistal map integrates the x-y maps at the monocular retinas, not from atemporal binary pulse code, but is an embryonically preset structurethat is hardwired in circuit modules in this embodiment. Here, z pulsesconverge to each x-y location in a distally reiterated map from the RGB,CMYK or other arrayed sensors, and so create an integrated map ofconvergent hues synchronized proximally-distally with each sensor x-ylocation (FIG. 2B). In physiological visual systems, 3D resolutionrequires high distal spike rates and reiterated spatial topography tosynchronize x-y aligned proximal monocular and distal binocularretinotopic maps. The circuitry of each successive convergent nodeselectively responds to the spatial and temporal synchronies resultingfrom any perceptual feature, such as the tactually-sensed shape of astimulus, or the visual characteristics of a specific face, or hue of anobject, or its smell, according to the type of peripheral sensor or thetopographical pattern of sensors stimulated, coupled with thespecificity of convergent serial circuits that only rapidly reemit zpulses from the most temporally and spatially synchronized input pulses.Convergent nodes the most distal from the proximal sensor array have nospecificity for sensor or pixel 2D location from phasic pulse inputs,but have synchronous proximal-distal timing with emitted times, or edgemicro-memories, from sustained pulses that reemit at a distallyreiterated map (FIG. 2B). Here a selective array of terminal nodes (150,250, 320) are initially least-time maximally responsive to rapidlyreemitted convergent pulse synthesis to identify a target, which zsynchronize by sustained latent convergence of z pulses, from specificsensor loci during the fixation period, to perceive the 2Dcharacteristics of the identified target.

Embodiment of Convergent Synchrony as a Locating and Grasping Mechanism

In an embodiment of this invention, reaching inaccuracies of a robotichand as it closes on an object, which are due to the increased relativemotion that stimulates imaging sensors with increased transitory data asthe object nears (FIG. 7B), can be reduced by not reconstructing serialimage frames at a central processor, which in current technologyrequires large amounts of data processed at a constant clock rate thatreconstructs image frames, therefore delaying and blurring the computedposition of the looming object (FIG. 7A). Likewise, locating andidentifying a distant object for perceptual relevance or looming dangeris facilitated if initial processing is by an array of topographicallyselective sensors that converge to nodes that respond fastest totemporally and spatially synchronous inputs from sensors thatselectively respond to traffic signs or looming situations. The delaysimplicit in reiterative processing here improves by the temporalsynchronization of z pulses between convergent nodes stimulated fromsensory 2D surfaces, so that the variable or motile edge information inthe image stays at the peripheral 2D sensory interface, but transmits 1Dz pulses at dynamic rates. These higher pulse rates synchronize the mostrapidly activated (or least-time) destination nodes with edge featurestransiently selected by specific, nano-sized sensors of different types(330). Reemitted z pulses at serial convergent nodes, with a timingperiodicity synchronized to the orthogonal sensor emission timing ofmotion-stimulated target-edge events, here do not preferentially respondto non-looming, distant stimulus features with little optical flow. Withincreased rates of motion-stimulated edge pulses from sensors nearingthe looming target object (FIG. 7B), more rapid spatial and temporalsummations synchronize at higher pulse frequencies at distal convergentcoincidence detector nodes, especially as the image object drifts acrossand is not centered on the sensor array. As shown in FIG. 6, alignedlocations of a target edge and the nearest sensor in an array,synchronize rapidly as a stimulus edge drifts across sensors; edgemotion and convergence of pulses due to a stimulated increase in targetsize to a node synergize, to increase the frequency and reduce thelatency of the edge emitted pulses at a serially convergent node. Theconvergent pulses that synchronize at maximal response rate and reducedlatency from the same target edge, increase precision of a sensor in thearray with respect to the target being located or grasped. Emitted pulsetimes in unaligned nodes (with respect to the serially aligned node paircurrently under observation nearest the target edge), may be interpretedby an observer as ‘error’ responses. But if the pair of serial nodes isadjusted so that pulse least-times and shortest travel distances areselected for observation, this target edge alignment error is muchreduced (shown by higher pulse frequencies in FIG. 7B). Increasedprecision does not require coding and transfer of negative feedbackinformation of off-center spatial reference locations to a centralprocessing unit (FIG. 7A), but coinciding 2D sensor and motor controlmaps rapidly stimulate corrective off-center pulse reactions, whichincrease convergent summation of ‘error’ and correctly aligned pulses toa last serial node(s) (FIG. 6) that responds in least-time, thereforemost precisely, to the moving aligned target edge.

In a similar aspect of the above embodiment that uses pulse repetitionsthat synchronize without transmitting temporally coded 2D information,the stimulation times of sensor emitted pulses are fixed asmicro-memories (FIGS. 3A, 4B), which increase precision and least-timemaximal response with increased pulse emission rates. Peripherallyemitted micro-memories at specifically mapped event or edge detectors,are retained as fixed emission times due to sequential synchronization,or phase-lock, with sustained proximally generated sensor pulsefrequencies. Again, if these fixed emission times sustain after a shortstimulation time or due to the sustained presence of the stimulus objecton sensors repeatedly stimulated at the peripheral gating frequency,distal z axis synchrony results. Circuitry embodied here that is roughlyanalogous to that in the brain's cerebellum, uses the topographicalinput lines, each with temporally synchronized z pulses, to increaseconvergent precision at a least-time reemitting node, despite thetemporal delays of pulses sustained from changing target positioning asa visual and/or tactile 2D sensor array nears the target (FIGS. 5, 6,7). Traditionally this is explained by negative feedback that uses therepeated application of the same algorithm to increase accuracy fromincreasingly precise reference coordinates if the target is stationaryor in a predictable trajectory (FIG. 7A). But due to feedback delays, ifthe target moves unpredictably, precision and accuracy are lost. It isalso established in physiological systems that efference copy, a form ofpredictive feedback, has two orders of magnitude less precision, atseveral arc-degrees, than the resolution of a retinal receptor with aprecision of a single arc-minute, so cannot stabilize the jittery imageof a target caused by FEMs. Here, these feedbacks are replaced by theorthogonal x-y precision at repeated sensory-motor 2D surfaces traversedby least-time z pulses, stimulated by a moving or stationary target. Inthe embodiment described here, sustained orthogonal shifting at thesensor surface across 2D x-y stimulus edges, clocks or gates therepetition of precise, fixed-time micro-memory 1D z pulses, whichtemporally synchronize the sustained emission of pulses that spatiallyconverge most rapidly along linked z axes. Because fixed emission,edge-generated times are preserved by the synchronized, rapid reemissionof z pulses in x-y topographical maps of the repeated micro-zonesurfaces in the cerebellum, the greater spatial resolution of sensors inclose proximity as a sensor array nears a target, serves to increase thetemporal and spatial precision of pulses stimulated by an unpredictablymoving target. In this embodiment, just-in-time increase in precision asa target nears is not in temporally coded feedback information, but isdue to fixed micro-memories of increased z pulse rates, causing morerapid temporal and spatial z pulse synchrony of sensory-motor alignedtopographical 2D surfaces (FIG. 7B). This proximal precision is notgoverned by a predictive efferent copy of low accuracy, but requires thecontinuously shifting transient alignment of temporally synchronous zpulses as they move through repeated topographically mapped 2D surfaces(FIGS. 5, 6), as hypothetically occurs in the cerebellum. Thisproximal-distal z synchrony tracks a moving target, detecting andreacting to small x-y deviations sensed by a sensory array in near realtime as a target looms in higher resolution (FIG. 7B).

In embodiments for the multiple functions of locating, identifying andgrasping a target here, increased convergence of generic 1D z pulsesthat more rapidly summate and reemit at an increasing rate or frequency,at a node in a distal array most closely x-y aligned (or least-timeprecise) with the target, are required. Here, 2D sensory data convergesx-y location intensities as generic multifunctional 1D z pulses withoutany binary coding or decoding of information to reconstruct a 2D image.As implemented here, continual sensor realignment due to the targetposition in space emits pulses that summate and synchronize more rapidlythan repetitive feedback of changing reference 2D location data;particularly useful in the embodiment here is that generic sensor pulserates increase with target looming and target size. If one uses neuralcircuits in the cerebellum as a model for the embodiment described here,the few distal long latency pulses align with new pulses at proximal 2Dmaps, to center moving visual and tactile sensors with motor x-ymisalignments (FIGS. 5, 6, 7B), which increase pulse rates just asmisalignments occur. The sensory response to mo-tor misalignmentsincreases in spatial and temporal resolution, due to more rapid rates ofpulse fixed emission times, as the sensory surface nears the loomingtarget (FIG. 7B). Conventional information feedback of changing targetreference locations via looping circuits introduces delays, which causefeedback gain error and oscillations.

An Embodiment of Convergent Synchrony for Brain Machine Interfaces

The continuous motor realignment of the sensors composing a surface asit nears a target, in response to targeting error, is also important forthe design of BMIs. BMIs require the repetitious application ofalgorithms to decode, or translate, cognitive cortical spike patternsinto muscle contractions specifically directed to a particular reach andmuscular configura-tion with respect to the recognized target. However,in contrast to muscle potentials re-corded peripherally in response tocognitive intention, there is much variance, from day to day and trialto trial, in these cortical spike patterns, even though inputs are thesame. The heterogeneous inputs, recorded at synchronous times by anelectrode array on the cortex, are due to the unknown origins andemitted times of the recorded spikes from other cortical areas, alongwith neural adaptation and varied tuning over time of specific neuronsto prop-erties of the motor movement, such as its varied direction,distance and speed to the same reach endpoint. Because spike patternsare conventionally interpreted to be a code requiring decoding ofdistance, speed and directional information as a reach occurs,experimental variance exists. Here this variance is resolved by theinterpretation that successive spatial and time synchronies of z spikesat convergent nodes in sensory-motor 2D surfaces reemit as a 1D zdimension, as shown in FIG. 6 (based on the simple convergent mechanismof FIG. 3B), which is synchronous with, but does not encode 3D movementinformation that is emitted from heterogeneous nodes of varyingdistances and locations from the cortical recording electrodes. In theembodiment described here, because only the reach endpoint is preset inadvance (FIG. 5), sensory-motor x-y alignments readjust in nearreal-time, proximal-distal synchronization of the z dimension. This 1D zpulse rate emitted by any node, as defined here, is synchronous atserial, distally increasing locations along convergent routes during thereach (FIG. 5), however aggregation of heterogeneous spike signals tomake the signal less noisy loses this serial temporal specificity thatis present in single trials and in distal nerves in which pulseintensity activates terminal muscle fibers at any specific time. Thecoding-decoding process of conventional BMIs also creates a feedback lagthat is inherently variant with respect to the time of the sensoryinputs (FIG. 7A). In fact, recorded spike times, measured as durationand amplitude in experiments, are the dominant physiologically invariantproperty (here, this invariance is the constant ratio of proportionallocation/time of pulses in the z dimension). At the start of a reach inmotor cortical populations of neurons, information about reachcharacteristics such as distance, speed or direction are not initiallymeasurable in the trial. Statistical analysis of the complete dataresults in a single dimension of time that is shown graphically to beinvariant, despite the multiple dimensions of the reach (its distance,speed and direction) which do vary, and is most predictive of subsequentshortening of reaction times in trial-to-trial reach experiments. Arealization of the embodiment here as shown in FIG. 6, with a moreprecise knowledge of the origins, emitted times and latencies ofspecific spikes, routes and convergent connections between and within 2Dsurface maps, can be obtained with multiple cortical electrode arrays.Proximal-distal distributed computation can synchronize realignments asthey shift among neurons during the course of the reach to a target. Thefocused z synchronization to a single x-y alignment as resolutionincreases near the target (FIG. 7B), is proposed here to increaseaccuracy, without the repeated application of algorithms that delay theresultant target's computed location. The inherent lag of loopingfeedback circuits (FIG. 7A), along with the heterogeneous factors statedabove, limits accuracy and precision of current algorithmic methods usedin BMI experiments, which have a reported variance of 50-70%. Because zlocation/time here is 1D and is the dominant property at high resolutionat convergent x-y locations of linked serial nodes (as shown in FIG.3B), the proximal-distal z synchrony of pulses in the embodiment here,reduces probabilistic variability of synchronous pulses as lagdiminishes near the target at higher stimulated pulse frequencies (FIG.7B).

To recapitulate, the sensor-generated fixed emission times of pulsesstimulated by edges or the filled area of a stimulus object, constitutea population of collective micro-memories with temporal and spatialprecision, which spatially and temporally synchronize at frequenciesinversely proportional to the distance and latency between linked nodes(FIGS. 2A, 2B, 2D). The population of proximal sensors activated bystimulus edges, responds synchronously to the gated frequency of theshifter array (FIG. 4A) or to larger movements of a stimulus across thearray (FIG. 6), due to the high spatial resolution of the sensor arrayand temporal resolution of the emitted z pulses. The serial outputs ofconvergent nodes in aligned, repeated 2D surfaces would thus convey asequence of spatially varying population responses, at any clock- orgated increment of synchronized pulses, which is due to rapidlyreemitted temporal and spatial convergence within the sustainedproximal-distal synchrony best visualized and enabled by 2D time (FIGS.4A and 4B; 3D time of 3D physiological volumes are not shown). Theembodiment here requires that sensor-emitted pulses temporallysynchronize proximally detailed or moving stimulus information as itoccurs in near real time, with distal z pulses recorded at the cortex inlatent perceptual time. Proximal sensory-motor time near the target isvery precise due to higher pulse rates, which, when synchronized atcortical recording sites more latently in time, is perceived in acontext of proximal-distal temporal synchrony. This embodiment andothers can be used with data stored in various memory devices such asRAM, ROM, EEPROM, the cloud or various other data storage circuits.

Theory of Synchronized Memory Retrieval

In the embodiments, aspects and variants of the invention described herethere is no transfer of conventional temporally coded information by 1Dz pulses. Parallel 1D z pulses emitted cyclically at an array frequency(FIG. 4B) (in conventional physics, interpreted as planar or surfacewaves), comprise a synchrony that does not transmit coded informationthat reconstructs a sensory image, but which phase-lock serial arrays ofnodes up to and including a last array. The properties of sequential,synchronous, emitted and latent time are intrinsic qualities transientlypresent in generic z pulses as they speed through connected paths ofconvergent nodes in serially aligned arrays (FIGS. 3B and 4A, 4B). Aninterchange of time and space between moving pulses and fixed nodes iscontextual, based on a time that is not standardized by convention, buton the equation c=frequency (variable time unit)×wavelength (inverselyvariable z distance). Rapid synchronization (or ‘anticipatorysynchronization’) requires multiple pulses at a frequency and speed thatare transiently present at each serial 2D surface over an encompassedinterval of distance/time with a constant ratio. In traditionalcircuits, it is required that information is encoded in a form, such asmultiplexing, so that informational conflicts are not at an emergentperceptual or decoded level; 1D z pulses, in contrast, retain convergent1D fixed emission times that temporally synchronize with complex 2Dinformation impinging on sensor surfaces, and as organized on 2Dcortical surfaces or in serial arrays, such as those in the hippocampus.If an emitted pulse has lasted through several layers of convergentnodes to accrue a long latency at a long z distance, with anaccompanying long synchronization period, its endur-ance has aperceptual validity over pulses with shorter emitted durations.

In physiological and physical systems, the characteristic unit time isproportional to the characteristic unit distance for any specificmaterial, to give a characteristic constant speed; this photon orelectronic pulse speed is a constant called c. C is not only constant atany relativistic speed of any visual observer, but constant c speed isalso due to any unitary time inversely proportional to unit distance inany observer neurons, as in the equation c=frequency×wavelength, whichholds in the repeated, anatomically defined repetitive 2D arrays in anyobserver's visual system, in hippocampal areas and cortical surfaces.The repeated, event-stimulated spikes that traverse 2D arrays, create arelativistic context in which the sequential fixed times of multiple 1Dspikes rapidly synchronize and reemit from fixed 2D arrays thatsynchronize time orthogonally and reemit in sequential z time. Therelative observer's coordination at a single distance or location, withthe distances of locations of other observers (or proxy instruments) atthe relativistic constant c, requires this transformation of externalvariable unit times and distances to x-y edge-stimulatory sensor eventsthat emit 1D z pulse fixed times as micro-memories. That relativisticpulse speed of micro-memories is a constant distance/time ratio thatcoincides with synchronous activation of wavelengths and frequencies atstationary 2D arrays of nodes, is not just coincidence, but a mechanismthat ties cognitive search of memories at specific 2D memory locationsin which moving, fixed micro-memories (FIG. 3A) of 1D z pulse time andstationary nodes in 2D arrays are relativistically interchangeable whensynchronized.

As an impedance matching mechanism, the speed of z pulse emission dz/dt(distance/latency), synchronizes 1D z pulse rate as moving z locationswith orthogonal 2D x-y topographical arrays of nodes. Thesynchronization of 1D z pulse speed, pulse emitted rate and distancebetween orthogonal 2D locations, as well as relativistic relationshipsbetween the reference visual observer's synchronized sensor plane andother observers with synchronized sensor surfaces, is shown with theintegrative constant c of pulses emitted direction-ally on any z axis. Cis a relativistic constant because it matches various external opticflow speeds at varied spatial z distances with any observer'sorthogonally synchronized 2D reti-nal plane, which synchronizes output zspikes (despite the asynchronous phases and frequencies of receivedinputs) with each cycle of an observer's physiological FEMS or clockrate. In modern physics the constant ‘c’ is an externally measuredproperty (however the origins of this constancy are philosophical andperceptual (in a book by the physicist Ernst Mach in 1900), whichcouples the ‘c’ constant, measured at any observer's orthogonallysynchronized sensory plane or measuring instrument, with z axis photonsemitted and received from physical space. Measured c is a constant ratioin 3D connected space perceived by any single observer, thus definingthe impedance match of proportional 10 distances and transit times ofemitted photons in 3D space, with sequential synchronized 1D z pulsetimes gated at serial orthogonal 2D surfaces. Orthogonal 2D x-y arraysand moving 1D z axis pulse or spike locations synchronize as one 3Dresonant structure, so that disso-nantly timed impingement of 3D emittedphotons acquire a regular, or synchronized context, from spatial andtemporal summations that reemit from nodes.

What is claimed is:
 1. A system comprised of at least one of a pulsesselectively propagated through a set of serial 2 dimensional (2D) arraysimplemented as an electrical network, the system comprising at least oneof a sensors in a first array that emit the pulses due to at least oneof visual, haptic, microwave or ultrasound stimulation, via linksconnecting to at least one of a nodes in the serial arrays, the pulsesserially propagating by emission of at least one of the input pulses toat least one the nodes in the serial arrays, with a minimal summationnumber of the pulses and a maximal temporal summation durationconfigured as a parameter, adjustable to reemit at least one outputpulses, which pulses in turn, converge as inputs to at least one thenodes in downstream arrays, thereby serially propagating pulses to atleast one the nodes in the last serial array; wherein, stimulationcomprising at least one of a) a feature pattern and b) a sequentialmoving event, empirically determined as a target from previousapplication of a same and similar stimuli, emits pulses from sensorsthat selectively propagate in serially linked nodes, and which pulsesemitted from at least one the stimulated sensors of the first arrayreemit serially from the downstream nodes to at least one said nodes inthe last array; wherein input pulses, which emit output pulses from atleast one nodes configured by the adjustable parameter, emit an outputpulse latency required to travel a linkage distance between at least onethe nodes and at least one the downstream serial nodes, which pulselatencies summate to the maximal temporal duration of at least onenodes, which duration is adjustable as the parameter necessary to emitat least one output pulses from at least one the nodes from temporallysynchronous input pulses, which outputs reemit a least-time summatedduration of pulses to at least one nodes in the last array; wherein thepulses emitted by stimulated sensors, by the least-time selectivepropagation of said pulses reemitted through the serial nodes to atleast one the nodes in the last array, serially reemit from the targetstimulated 2D locations in the sensor array to at least one nodes in thelast array, in which at least one of 1) at least one the stimulatedsensors signal a 2D array location, 2) a reference position isdesignated, 3) no 2D array location or reference position is signaled bysensors.
 2. The system of claim 1, whereby the stimulus feature patternemits temporally synchronous pulses from a group of the sensors or nodesby links to at least one the serial nodes, which rapidly emit outputpulses when the feature pattern substantially matches at least one thesensor or node group pattern, whereby reemitted 1D pulses input todownstream nodes that reemit pulses from substantially synchronouspulses to at least one serially connected nodes, and thereby reemit amaximal frequencies or a rates of serially selective pulses, from thearray locations of stimulated sensors to at least one the nodes in thelast array.
 3. The system as in claim 2, in which at least onetemporally synchronized pulse latencies aggregate as a pulse frequenciesemitted between at least one nodes and at least one downstream serialnodes, in which the maximal summated pulse durations are adjustable withthe parameters to cause reemission of pulses from at least one theserial nodes to nodes in the last serial array, in which concurrentlyemitted sensor 2D array pulses, by at least one serially synchronizedpulse frequencies, operationally connect to downstream nodes, includingat least one the nodes in the last serial array.
 4. The system of claim3, comprising a sensor array frequency is caused by a frame rate or anoscillation frequency of the sensor array, or a relative motion betweenthe sensor array and an occluding screen configured with a periodicamplitude substantially matching a minimal diameter of the sensors inthe array, whereby configuration of said array frequency sustains pulsesthat synchronize with the pulse frequencies or a harmonics thereof, thepulse frequencies adjusted by the parameters so that at least one pulsereemits from summation of the minimized latency pulses to at least oneserial downstream nodes to at least one said nodes comprising the lastserial array.
 5. The system of claim 4, wherein the array frequencysustains pulses emitted by the stimulus target that synchronize with theat least one pulse frequency or harmonics thereof, selectively propagateas convergent 1D pulse locations with serial emitted times, whichoperationally connect as at least one temporally synchronized pulsefrequencies, target stimulated sensors at 2D array locations withconvergent 1D pulses selectively reemitted by at least one nodes in thelast serial array; wherein, the synchronization of the array frequencieswith emitted pulse temporal frequencies, which impedance matches 2Darrays and 1D pulses through those arrays, is expressed as at least oneof a direct proportionality of a distance/latency and an inverseproportionality of a frequency multiplied by a wavelength, coupling atleast one emitted pulse a micro-memory and at least one a fixed arraylocation.
 6. The system of claim 5, wherein sustained said pulses,selectively propagated due to the temporal synchrony of the pulsefrequencies of substantially equal convergent latencies from thestimulated sensors, serially reemit from serial nodes at the pulsefrequencies adjusted by the parameters to most rapidly reemit seriallyconvergent output 1D pulses from downstream nodes in the set of serialarrays to at least one the nodes in the last array.
 7. The system ofclaim 6, comprising the parameters that modify the emitted pulsefrequencies between at least two the serial nodes, are adjustable withat least one of a configured controls, thereby optimizing the convergentreemission of spatially and temporally synchronous pulses, for increasedprecision and accuracy of output pulses and so with a temporalresolution of emitted pulse times, in which said output temporalresolution increases with maximized said frequencies of the convergentoutput 1D pulses to at least one the downstream serial nodes.
 8. Thesystem of claim 7, comprising that stimulation by the target, ofsynchronous pulses at the array frequency with serial emission timesfrom a pair of monocular sensor arrays, move via the shortest latencylinks to at least one binocular nodes in at least one serial arrays thatsummate convergent temporally synchronous pulses, which thereby reemit1D output pulses at said maximal frequencies from at least one thebinocular nodes; wherein, monocular emitted pulses, at one cycle of thesynchronized 2D array frequencies and 1D pulse frequencies, issufficient to represent 3D connectivity of varied stimulus targetdistances, at one synchronized 2D time and 1D emitted time; wherein, thestimulated pulses emitted from a pair of the monocular arrays at thearray frequency, determines, from the emitted times of pulses from thesame target pattern edges that rapidly remit 1D output pulses fromconvergent binocular nodes adjusted for precision and accuracy by theparameters, the location of the stimulus target with reference to themonocular arrays, or with reference to the reference position, orembodied in a stereoscopic device.
 9. The system of claim 8, wherein thelinked nodes in serial arrays, includes but is not limited to at leastone of: 1) the temporal synchronization of the input pulses with theoutput pulses at pulse frequencies adjusted with the parameter betweenat least two the serial nodes; 2) said stimulated sensors in the firstarray that emit pulses with serial emitted times over a sustained time,do not lose said temporal resolution at emitted pulse frequenciessynchronized with the emitted array frequency.
 10. The system of claim9, wherein the sustained emitted times of sensor pulses stimulated bythe target, which selectively propagate as the serial output 1D pulses,do not necessarily encode, multiplex or attach the information of the 2Darray locations of emitting nodes in said reemitted pulse frequencies ofserial 1D output pulses that converge to at least one nodes in the lastarray.
 11. The system of claim 10, wherein the sensor pulses emitted atthe array frequency, synchronize with the pulse frequencies by adjustingthe parameters, whereby the adjustment synchronizes the pulse frequencyemitted by the features of said target with the duration to at least onedownstream serial nodes, in which a pulse timing precision at serialnodes increases with increased pulse numbers summating within a shorterduration of time, in which the rapidly reemitted pulses, at maximizedfrequencies with closer emitted times, are a temporal measure of theprecision of the target features.
 12. The system of claim 11, comprisingthat the adjustment of the parameters varies the pulse frequencies to atleast one the nodes in the last array, which empirically selects theprecise and accurate emitted pulses of the target from pulses emitted bysimilar features of a different target, but which similar targetfeatures selectively propagate convergent output pulses, with all otherfactors kept controlled, via at least one of a) reemitted pulses of alesser number and reduced frequency to at least one said nodes in thelast array, and b) reemitted pulses of a differing frequency to one ormore different nodes with differing target selectivity in the lastarray.
 13. The system of claim 12, wherein the selective propagation ofpulses rapidly reemitted to at least one the nodes in the last array,accurately recognizes the precise target features empirically determinedby prior presentation of said target, shown empirically by convergenceof serial pulses to at least one the target-selective nodes in the lastarray, and empirically tested with different targets composed of similarfeatures, in which pulses from said target features selectivelypropagate maximal frequency output pulses, due to convergence oftemporally synchronous pulses emitted by the said target features todownstream nodes in serial arrays, which reemitted pulses therebyoperationally connect the sustained pulses emitted from the sensor arrayby said target features, with at least one said target stimulated nodesin the last array that maximally respond in the least-time to serialconvergent pulses emitted by the target feature pattern.
 14. The systemof claim 13, wherein said target feature pulses emitted at the sensorarray frequency, which selectively propagate by emitting maximalfrequencies of temporally synchronous pulses at serial nodes, which byconverging 1D pulse outputs emitted by variable 2D orientations,locations and sizes of said target features, by adjustment of theparameters, thereby operationally connect the variable sensor arraylocations stimulated by the precise target features, with at least onetarget-stimulated nodes in the last array.
 15. The system of claim 14,further comprising additional nodes that record the emitted time and the2D sensor location of pulses emitted by said sensor array, with a recordof a received time and the location of at least one said nodes in thelast array that receive serially reemitted pulses that converge maximalfrequencies from said precise target features and similar targetfeatures, for an empirical determination of said sensor emitted andconvergent reemitted pulses to the target-selective nodes in the lastarray.
 16. The system of claim 14, wherein pulses temporallysynchronized at said pulse frequencies or the harmonics thereof,adjusted by the parameters, in which temporally synchronous convergenceof pulses at downstream serial nodes, serially reemit convergent outputpulses to the nodes in the last array, reduce pulse frequencies andincrease the selection by reemitted pulses of target features orpatterns that selectively stimulate nodes and groups of nodes in serialdownstream arrays, in which the selective propagation of pulses to atleast one node in the last array, does not require the sensor 2Dlocations to be determined to correct varying sensor locationsstimulated by the said target features or patterns, in convergent pulsesto at least one the nodes in the last array.
 17. The system of claim 16,wherein the pulses emitted by at least one the moving sensor arrays whenstimulated by at least one the target feature patterns and target movingevents, increase pulse frequency as at least one the sensor arraysapproach the target, due to a larger looming size of the target area,which increases the number of stimulated sensors, thereby causing moreprecise alignment of the sensors in the array due to a lesseningdistance to said target, whereby the increased pulse frequencies due tothe looming size of said target converge, summate and reemit morerapidly, at higher pulse frequencies, in downstream nodes to at leastone the nodes in the last array; wherein pulses emitted by the sensorarray increase in number due to increased a relative parallax motion ofthe target due to the lesser distance to the sensors, in which theincrease in the relative parallax motion causes higher frequencies ofpulses to converge to at least one the nodes in the last array, therebyoperationally connecting at least one the nodes in the last array withconcurrently emitted pulses stimulated by the moving target at thesensor locations, which aligns the target location accurately andprecisely with the 2D sensor location due to higher pulse frequencies,as the sensor array lessens the distance to zero at the looming target.18. The system of claim 1, wherein pulses or spikes are bothimplementable as similar moving 1D locations with emitted times at thearray frequency, but that in embodiments here, do not necessarily encodeinformational 2D signals that matches patterns with at least one of asensor image pattern stored in memory.
 19. The system of claim 1,wherein embodiments are at least one of digital and analog circuits innodal networks implemented as at least one of neural networks, in whichthe reference position can be implemented by at least one of roboticgraspers, brain computer interfaces, prosthetic devices and optic flowdevices, or any other device or instrument, in which at least one ofspeed and accuracy and precision of target recognition, categorization,identification and location are increased by the embodiments describedin this invention.
 20. A method comprising emission of at least one apulses from a sensor array stimulated by at least one of 1) a targetfeature pattern and 2) a moving target event, in which pulsesselectively propagate in steps of a serial summations of temporallysynchronous pulses at a serial nodes in a set of serial arrays,reemitting to at least one the nodes in the last serial array; whereinthe serial nodes serially summate pulses with serial emitted times setby configuration of a sensor array frequencies, to summate output saidpulses that reemit to downstream nodes, including at least one the nodesin the last array, whereby said steps of selective convergence of pulsesat serial nodes establishes at least one of a pulse frequencies, whichsummate pulse latencies as a duration at each serial downstream nodesadjusted with a parameters to emit at least one pulses to downstreamnodes in serial arrays, thereby operationally connecting, at thesynchronized pulse frequencies or a harmonics thereof, at least one of aconcurrent pulses emitted from sensors by the target feature pattern orevent, with at least one an empirically determined the nodes in the lastarray that responds most rapidly and maximally to a minimized totalduration of pulses emitted by at least one of the target feature patternand moving target event; wherein said minimized total duration of pulsesresults from a looming size or a relative parallax of the target as itnears the sensor array with increased an optical flow, so that as thesensor array reduces the distance in steps to zero nearest the target,the reemitted pulse frequency increases, thereby increasing a temporaland spatial resolution emitted by said pulses by the sensors at a targetlocation, which increases at least one of the precision and accuracy oftarget location, identification, categorization, recognition andextracted abstractions.